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adaptation law unit of the adaptive control system so that the 
adaptive control system does not adapt to the characteristic 
in controlling the plant. 


4,062,508 A 12/1977 Stephens et al. 


24 Claims, 11 Drawing Sheets 


10 

/V 







US 7,218,973 B2 

Page 2 


u.s. 

PATENT DOCUMENTS 

5,691,893 A 

11/1997 

Stothers 






5,692,708 A 

12/1997 

Coleman et al. 


5,241,509 

A 

8/1993 

Jousselin et al. 

5,768,124 A 

6/1998 

Stothers et al. 


5,253,328 

A 

10/1993 

Hartman 

5,796,608 A 

8/1998 

Bunzemeier 


5,268,834 

A 

12/1993 

Sanner et al. 

5,901,059 A 

5/1999 

Tao et al. 


5,274,746 

A 

12/1993 

Mashiko 

5,936,792 A 

8/1999 

Kobayashi et al. 


5,282,261 

A 

1/1994 

Skeirik 

6,026,793 A 

2/2000 

Yasui et al. 


5,303,385 

A 

4/1994 

Hattori et al. 

6,092,919 A 

7/2000 

Calise et al. 


5,311,421 

A 

5/1994 

Nomura et al. 

6,094,601 A * 

7/2000 

Popovich 

.. 700/28 

5,313,559 

A 

5/1994 

Ogata et al. 

6,216,047 B1 

4/2001 

Goto 


5,367,612 

A 

11/1994 

Bozich et al. 

6,230,062 B1 

5/2001 

Shah 


5,396,415 

A 

3/1995 

Konar et al. 

6,241,435 B1 

6/2001 

Huang et al. 


5,406,474 

A 

4/1995 

Hansen 





5,469,265 

A 

11/1995 

Measures et al. 

FOREIGN PATENT DOCUMENTS 


5,475,793 

A 

12/1995 

Broomhead et al. 

JP 08272378 A 

* 10/1996 


5,541,843 

A 

7/1996 

Yamaguchi et al. 

JP 09198106 A 

* 7/1997 


5,682,309 

A 

10/1997 

Bartusiak et al. 





5,687,075 

A 

11/1997 

Stothers 

* cited by examiner 






FIGURE 1 


10 





U.S. Patent May 15, 2007 Sheet 1 of 11 US 7,218,973 B2 












FIGURE 2 


input control signal d in 
to hedge unit 


commanded state signal x r 
from command unit 
plant state signal x p 

from sensor 

adaptive control signal v gd 
from adaptation law unit 
reference model state signal x 

from reference model unit 


rm 


140 rl 


-w 


CONTROL 

MODEL 


-w 


CONTROLLER 


142 

.. \ 

CONTROL 
ALLOCATION AND 
CHARACTERISTIC 
UNIT 


-14 


command control signal d cmd 


to actuator and hedge unit 


pseudo-control signal v pc 
to adaptation law unit 


U.S. Patent May 15,2007 Sheet 2 of 11 US 7,218,973 B2 


FIGURE 3 



U.S. Patent May 15, 2007 Sheet 3 of 11 US 7,218,973 B2 


FIGURE 4 



hedge signal v h 


from hedge unit 


U.S. Patent May 15, 2007 Sheet 4 of 11 US 7,218,973 B2 


U.S. Patent May 15, 2007 


Sheet 5 of 11 


US 7,218,973 B2 











U.S. Patent May 15, 2007 Sheet 6 of 11 


US 7,218,973 B2 


START 


GENERATE COMMANDED STATE 
SIGNAL x, AT THE COMMAND UNIT 
BASED ON OPERATOR ACTION 
AND/OR OPERATOR-GENERATED 
SIGNAL 


v FIGURE 6 

GENERATE PLANT STATE SIGNAL 
x BASED ON SENSED PLANT 
STATE 


RECEIVE PLANT STATE SIGNAL x„ 


GENERATE INPUT CONTROL 
SIGNAL d in AT CONTROLLER BASED 
ON COMMANDED STATE SIGNAL x r , 
PLANT STATE SIGNAL x AND 
ADAPTIVE CONTROL SIGNAL v s& 
AND OPTIONALLY REFERENCE 
MODEL STATE SIGNAL 


GENERATE CONTROL SIGNAL d cma 
AT CONTROLLER BASED ON THE 
COMMANDED STATE SIGNAL x r , 
PLANT STATE SIGNAL x AND 
ADAPTIVE CONTROL SIGNAL v sd 
USING CONTROL ALLOCATION AND 
CHARACTERISTIC UNIT 


GENERATE HEDGE SIGNAL v„ AT 
HEDGE UNIT BASED ON CONTROL 
SIGNAL d in , CONTROL SIGNAL d ^ 
OPTIONALLY ACTUATOR STATE 
SIGNAL x„, PLANT MODEL WITH 
CHARACTERISTIC WHOSE EFFECT 
IS TO BE REMOVED FROM 
TRACKING ERROR SIGNAL 
SUPPLIED TO ADAPTATION LAW 
UNIT, AND PLANT MODEL WITHOUT 
CHARACTERISTIC WHOSE EFFECT 
IS TO BE REMOVED FROM THE 
TRACKING ERROR SIGNAL 


GENERATE REFERENCE MODEL 
STATE SIGNAL x m AT REFERENCE 

im 

MODEL UNIT BASED ON 
COMMANDED STATE SIGNAL x r 
HEDGE SIGNAL v h , AND 
REFERENCE MODEL 


GENERATE PSEUDO-CONTROL 
SIGNAL v BASED ON COMMANDED 

STATE SIGNAL x r , AND PLANT - S 5 S13‘ 
STATE SIGNAL x AND REFERENCE 
MODEL STATE SIGNAL x m 


GENERATE TRACKING ERROR 
SIGNAL e AT COMPARATOR BASED 
ON PLANT STATE SIGNAL X AND 
REFERENCE MODEL STATE SIGNAL 


SUPPLY CONTROL SIGNAL rf, TO 

ACTUATOR bb 


CONTROL PLANT WITH ACTUATOR 
BASED ON THE CONTROL SIGNAL - S7 


SENSE PLANT STATE WITH 
SENSOR 


GENERATE ADAPTIVE CONTROL 
SIGNAL v ad BASED ON TRACKING 
ERROR SIGNAL e AND OPTIONALLY 
ALSO PLANT STATE SIGNAL x p AND/ 
OR PSEUDO-CONTROL SIGNAL 

A** 


STORE SIGNALS REQUIRED FOR 
NEXT COTNROL CYCLE POSSIBLY 
INCLUDING PLANT STATE SIGNAL 
x AND ADAPTIVE CONTROL 
SIGNAL 


S16 H 













Commanded Reference Model State Signal, x 


U.S. Patent May 15, 2007 


Sheet 7 of 11 


US 7,218,973 B2 



Tracking Error, e 















Hedge 
Signal, v h 


Figure 8 


U.S. Patent May 15, 2007 Sheet 8 of 11 US 7,218,973 B2 




Reference Model Unit 






FIGURE 10 


U.S. Patent May 15, 2007 


Sheet 10 of 11 


US 7,218,973 B2 



<L> 

> 



& s 

cd c 
T3 O 
cd o 












US 7,218,973 B2 



US 7,218,973 B2 


1 

ADAPTIVE CONTROL SYSTEM HAVING 
HEDGE UNIT AND RELATED APPARATUS 
AND METHODS 

CROSS-REFERENCE TO RELATED 
APPLICATION 

This application is a continuation under 35 U.S.C. §120 
and 37 C.F.R. § 1.53(b) of U.S. patent application Ser. No. 
09/585,106, filed on May 31, 2000 now U.S. Pat. No. 
6,618,631, which application claimed the benefit of provi- 
sional application No. 60/199,615, filed Apr. 24, 2000, 
which are hereby incorporated herein in their entirety by 
reference. 

STATEMENT OF U.S. GOVERNMENT RIGHTS 
IN THE INVENTION 

This invention was made with U.S. Government funding 
under Contract No. NAG8-1638 awarded by the National 
Aeronautics and Space Administration (NASA) — Marshall 
Space Flight Center and Contract No. F49620-98-1-0437 
awarded by the Air Force Office of Scientific Research 
(AFOSR). The U.S. Government has certain rights in the 
invention. 

FIELD OF THE INVENTION 

The invention is directed to an adaptive control system 
and related method. More particularly, the invention is 
directed to an adaptive control system with the capability to 
prevent or reduce undesired adaptation of a control system 
due to selected characteristic(s) of the plant or control 
system. 

BACKGROUND OF THE INVENTION 

Adaptive control systems have the capability to adapt 
control response to changing conditions within the plant 
being controlled or the plant’s operating environment. Adap- 
tation to changing plant or environmental conditions pro- 
vides enhanced control response for many kinds of plants, 
and may be required for certain types of plants that cannot 
be controlled with static control systems. However, conven- 
tional adaptive control systems have a tendency to adapt to 
plant or control system characteristics to which they should 
not. The control response of adaptive control systems can be 
greatly diminished when subjected to certain characteristic 
(s) of the plant or system, and can be rendered unstable in 
attempting to adapt to these characteristics. An example of 
a characteristic that could adversely affect an adaptive 
control system is a control or authority limit imposed on the 
control elements of an adaptive control system. If an opera- 
tor generates a command signal that exceeds the ability of 
the control system or plant to respond, adaptation of the 
control system can render the control system unstable. It is 
desirable to reduce or prevent the impact of such character- 
istic^) from adversely affecting the adaptive control sys- 
tem’s performance. 

SUMMARY OF THE INVENTION 

The methods, apparatus, and system, of the invention 
overcome the disadvantages noted above. 

A first method of the invention comprises generating a 
hedge signal to avoid adaptation to a characteristic of at least 
one of an adaptive control system and a plant controlled by 
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such system. The first method can comprise modifying a 
commanded state signal with the hedge signal. The first 
method can also comprise generating a reference model state 
signal using the commanded state signal modified by the 
5 hedge signal. The first method also can comprise generating 
a tracking error signal based on the reference model state 
signal and a plant state signal, and generating an adaptive 
control signal to adapt control response of the adaptive 
control system. Through compensation for the characteristic 
to in the tracking error signal, the adaptive control signal can 
be generated so as not to significantly adapt to the charac- 
teristic. Hence a characteristic of the plant or control system 
that would impair or be detrimental to control system’s 
performance and/or stability can be hedged out of the 
15 adaptive portion of the control system to prevent adverse 
impact on control of the plant. The hedge signal can be 
generated based on a difference between a first signal 
derived from a plant model not having the characteristic to 
be hedged, and a second signal derived from a plant model 
20 having the characteristic. The first signal can generated 
based on an input control signal and a plant state signal in 
addition to the plant model not having the characteristic. The 
second signal can be generated using a command control 
signal and a plant state signal, in addition to the plant models 
25 with the characteristic. The input control signal can be 
generated based on a commanded state signal, a plant state 
signal, and an adaptive control signal, and the command 
control signal can be generated using the input command 
signal modified by a control allocation and a control char- 
30 acteristic imposed by a controller. The input control signal 
and command control signal can be used to hedge a char- 
acteristic of the control system to which adaptation is not to 
be performed. The method can also include generating a 
display based on the input control signal. An operator can 
35 use the display to generate a command control signal. In this 
aspect of the invention, the operator’s control and response 
can be hedged. 

A second method of the invention is executed by an 
adaptive control system. The second method comprises 
40 generating an input control signal based on a commanded 
state signal, a plant state signal, and an adaptive control 
signal. The second method also comprises generating a 
command control signal based on a commanded state signal, 
a plant state signal, an adaptive control signal, and further 
45 based on control allocation and a control characteristic of a 
controller used to generate the command control signal. The 
second method further comprises supplying the command 
control signal to an actuator, controlling a state of the plant 
based on the command control signal, sensing a state of the 
50 plant, and generating a plant state signal based on the 
sensing of the plant. The second method comprises gener- 
ating a first signal based on the input control signal, the plant 
state signal, and a plant model without a plant characteristic 
to which the adaptive control system is not to adapt. The 
55 second method also comprises generating a second signal 
based on the command control signal, the plant state signal, 
and a plant model with the plant characteristic to which the 
adaptive control system is to adapt. The second method 
further comprises generating a hedge signal by differencing 
60 the first and second signals, and generating a reference 
model state signal by modifying the commanded state signal 
with the hedge signal to include the effect of the control 
allocation and control characteristic on plant state from the 
reference model state signal. The second method further 
65 comprises comparing the plant state signal and the reference 
model state signal, generating a tracking error signal based 
on the comparing step, and generating the adaptive control 
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signal based on the tracking error signal. The second method 
can comprise generating a reference model signal based on 
the commanded state signal, the hedge signal, and a refer- 
ence model signal derived from a reference model repre- 
senting the target response of the plant, the reference model 5 
signal to generate the input control signal. The second 
method can also comprise generating a reference model 
signal based on the commanded state signal, the hedge 
signal and a reference model signal derived from a reference 
model representing the target response of the plant, the to 
reference model signal, to generate the command control 
signal. The second method can also comprise generating a 
linear control signal based on the tracking error signal, 
generating a reference model signal based on the com- 
manded state signal, the hedge signal, and a reference 15 
model, and generating a pseudo-control signal based on the 
linear control signal, the reference model signal, and the 
adaptive control signal, and the pseudo-control signal. The 
adaptive control signal can be generated with the plant state 
signal. The adaptive control signal can be generated with a 20 
neural network having comiection weights adjusted based on 
the tracking error signal and the pseudo-control signal. The 
neural network maps the plant state signal to the adaptive 
control signal. The plant state signal can also be used to 
generate the adaptive control signal. The second method can 25 
comprise generating the commanded state signal based on a 
control action from an operator. The operator can be human, 
and the method can comprise generating a display based on 
the plant state signal. The display can be used by the 
operator to generate the commanded state signal. The second 30 
method can comprise generating the commanded state signal 
based on a sigial generated by an operator that is a com- 
puter. The second method can also comprise generating a 
display for an operator based on the input control signal so 
that the operator can generate the command control signal 35 
based on the display. 

An apparatus of the invention can be used in an adaptive 
control system for controlling a plant. The apparatus is a 
hedge unit coupled to receive at least one control signal and 
a plant state signal. The hedge unit generates a hedge signal 40 
based on the control signal, the plant state signal, and a 
hedge model including a first model having a characteristic 
to which the adaptive control system is not to adapt, and a 
second model not having the characteristic to which the 
adaptive control system is not to adapt. The hedge signal can 45 
be used in the adaptive control system to remove the 
characteristic from a signal supplied to an adaptation law 
unit of the adaptive control system so that the adaptive 
control system does not adapt to the characteristic in con- 
trolling the plant. The characteristic to be hedged by the 50 
hedge unit can be a time delay between generation of the 
commanded state signal by the controller at a time, and 
receipt by the controller of the plant state signal resulting 
from the commanded state signal generated at the time. 
Also, the characteristic can be a time delay between gen- 55 
eration of a state by the plant and sensing of the state of the 
plant by the sensor to generate the plant state signal. 
Alternatively, the characteristic can pertain to a control limit 
of the actuator used to control the plant. The control limit 
can be due to actuator end points, actuator dynamics, a rate 60 
limit of the actuator, or quantization effects associated with 
the actuator, for example. 

An adaptive control system of the invention is coupled to 
receive a command state signal indicative of a target state of 
a plant controlled by the adaptive control system. The 65 
adaptive control system comprises a controller coupled to 
receive the commanded state signal, a plant state signal, and 
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an adaptive control signal. The controller generates an input 
command signal based on the commanded state signal, the 
plant state signal, the adaptive control signal, and a control 
model. The controller generates a command control signal 
based on the commanded state signal, the plant state signal, 
the adaptive control signal, the control model, control allo- 
cation of the controller, and at least one control characteristic 
of the controller. The controller is coupled to supply the 
command control signal to the plant to control the plant’s 
state. The actuator is coupled to receive the command 
control signal, and affects physical control of the plant’s 
state using the command control signal. The adaptive control 
system can comprise a sensor coupled to sense the plant 
state, that generates a plant state signal based on the sensed 
plant state. The adaptive control system also comprises a 
hedge unit coupled to receive the input control signal, the 
command control signal, and the plant state signal. The 
hedge unit generates a hedge signal to modify the command 
state signal based on the input control signal, the command 
control signal, the plant state signal, and a hedge model 
indicative of a characteristic of at least one of the plant and 
the adaptive control system, to remove the effect of the 
characteristic on a tracking error signal. The adaptive control 
system also comprises a reference model unit coupled to 
receive the command state signal and the hedge signal. The 
reference model unit generates a reference model state 
signal based on the commanded state signal and a hedge 
signal. The adaptive control unit also comprises a compara- 
tor unit coupled to receive the reference model state signal 
and the plant state signal. The comparator unit generates a 
tracking error signal based on a difference between the plant 
state signal and the reference model state signal. The adap- 
tive control system also includes an adaptation law unit 
coupled to receive the tracking error signal. The adaptive 
control system generates the adaptive control signal based 
on the tracking error signal. The adaptation law unit is 
coupled to supply the adaptive control signal to the control- 
ler. The controller can generate the input control signal and 
the command control signal further based on the reference 
model state signal. The characteristic to be hedged by the 
adaptive control system can be time delay between genera- 
tion of the commanded state signal by the controller at a 
particular time, and receipt by the controller of the plant 
state signal resulting from the commanded state signal 
generated at the particular time. Alternatively, the charac- 
teristic can be a time delay between generation of a state by 
the plant in response to the command control signal, and 
sensing of the state of the plant resulting from the command 
control signal. Further, the characteristic can be a control 
limit of the actuator used to control the plant. The control 
limit can be due to actuator end points, actuator dynamics, 
a rate limit of the actuator, or quantization effects of the 
actuator, for example. Hie commanded state signal can be 
generated by an operator, and the adaptive control system 
can comprise an operator interface unit coupled to receive 
the plant state signal. The operator interface unit relays the 
plant state to the operator. The command unit can be used by 
the operator to generate the co mm and state signal based on 
the operator’s control action. The operator interface can be 
a display generated based on the plant state signal. The 
operator can be a human being that generates the control 
action to the command unit to generate the commanded state 
signal. The commanded state signal is generated by a 
machine operator based on the plant state signal. The 
adaptation law unit can comprise a neural network having 
comiection weights determined by the tracking error signal. 
The neural network can map the plant state signal to the 
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adaptive control signal based on the connection weights to 
generate the adaptive control signal. The controller can 
generate a pseudo-control signal based on the commanded 
state signal and the plant state signal. The controller can be 
coupled to supply the pseudo-control signal to the neural 
network to adjust the connection weights of the neural 
network. The controller can comprise a dynamic inversion 
unit to generate the command control signal. 

These together with other objects and advantages, which 
will become subsequently apparent, reside in the details of 
construction and operation of the invented methods, appa- 
ratus, and article as more fully hereinafter described and 
claimed, reference being made to the accompanying draw- 
ings, forming a part hereof, wherein like numerals refer to 
like parts throughout the several views. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a general block diagram of the adaptive control 
system of the invention that uses a hedge signal to hedge 
against a characteristic to which the adaptive control system 
is not to adapt; 

FIG. 2 is a block diagram of a controller of the adaptive 
control system that generates a command control signal to 
control an actuator affecting a state of a plant; 

FIG. 3 is a block diagram of a hedge unit of the adaptive 
control system; 

FIG. 4 is a block diagram of a reference model unit of the 
adaptive control system; 

FIG. 5 is a view of a processor-based system for imple- 
menting the adaptive control system of FIGS. 1-4; 

FIG. 6 is a flowchart of a method of the invention used to 
generate a hedge signal to prevent or reduce adaptation of 
the adaptive control system of FIGS. 1-4 to the character- 
istic that is to be hedged; 

FIG. 7 is a block diagram of an adaptive control system 
that includes a neural network for generating an adaptive 
control signal based on a tracking error signal and a pseudo- 
control signal; 

FIG. 8 is a relatively detailed block diagram of a hedge 
unit used with the adaptive control system of FIG. 7; 

FIG. 9 is a relatively detailed block diagram of a reference 
model unit used to implement a second-order reference 
model to generate a target reference model state response to 
a commanded state signal; 

FIG. 10 is a relatively detailed view of a neural network 
that can be used to map a tracking error signal and a plant 
state signal to an adaptive control signal using connection 
weights set adaptively based on a tracking error signal, a 
pseudo-control signal, and the plant state signal; and 

FIG. 11 is a block diagram of a control and allocation and 
characteristic unit in a special case in which an operator is 
included in the unit. 

DETAILED DESCRIPTION OF THE 
INVENTION 

As used herein, the following terms have the following 
definitions: 

“Actuator” can be virtually any device capable of affect- 
ing the state of a plant to control a degree of freedom thereof. 
Such actuator can be a motor, motor-driven screw, a hydrau- 
lic cylinder, a pump or valve controlling a stream of air, a 
thermal heater, a compressor or suction generator, or other 
device. 
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“Adaptive control system” means a control system having 
the capability to adapt to changes in a controlled plant or its 
environment over time. 

“Characteristic” is a property of a plant or control system 
5 that has an effect for which adaptation of the control system 
is not to be performed. The characteristic can be a time delay 
between generation of a command signal and sensing and 
report of the plant state resulting from the command signal 
to the control system. The characteristic can also be a control 
to limit such as actuator end points, e.g., extreme positions, 
temperatures, pressures, etc. obtainable by the actuator, 
actuator dynamics, rate limits, quantization effects, and 
possibly others. The characteristic can also be a feature of a 
sensor, for example, the time delay from change of a plant 
15 state to sensing of that changed plant state by the sensor. The 
characteristic can also be an operator’s control or response. 

“Control limit” is a limit on the capability of a control 
system to control a plant. A control limit can also be imposed 
by limitations in the actuators used to control the plant. 
20 These limitations can include actuator end points, e.g., 
extreme positions, temperatures, pressures, etc. obtainable 
by the actuator, actuator dynamics, rate limits, quantization 
effects, and possibly others. Control limits could also be 
imposed intentionally for a variety of reasons. Adaptive 
25 control systems are sensitive to control limits that can cause 
the adaptive control systems to lose stability. The invention 
provides the capability to compensate for control limits to 
permit stable control of the plant with the adaptive control 
system. 

30 “Hedge” means to reduce or prevent adaptation of an 
adaptive control system to a characteristic. 

“Hedge model” is a model of one or more elements of the 
system or plant with and without a characteristic that is to be 
hedged. A hedge model may be a model of a plant, a control 
35 system, e.g., an actuator or sensor, an operator, or any other 
feature of the control system or plant to which the control 
system is not to adapt. 

“Operator” can be a human or computer, for example, that 
senses a plant state using a plant state signal, and generates 
40 a commanded state signal to control the plant. 

“Plant” refers to a system controlled by a control system. 
For example, the plant can be an aircraft, spacecraft, space- 
launch vehicle, satellite, missile, guided munition, automo- 
bile, or other vehicle. The plant can also be a robot, or a 
45 pointing or orientation system such as a satellite orientation 
system to orient power-generation panels, a transceiver, or a 
docking mechanism. Such plant can also be a braking 
system, an engine, a transmission, or an active suspension, 
or other vehicle subsystem. The plant could be a manufac- 
50 hiring facility or a power generation facility. The plant could 
also be virtually any controllable system. 

“Sensor” can be virtually any device(s) for sensing a 
degree of freedom of a plant’s state, whether alone or in 
combination with one or more other sensors, to generate a 
55 measurement or estimate of plant state. The sensor can be 
virtually any device suitable for sensing information regard- 
ing a plant’s state. For example, the sensor could be a 
gyroscope for detecting orientation of a vehicle such as an 
aircraft, i.e., pitch or roll attitudes or side slip. The sensor 
60 can also be a temperature or pressure sensor, a position, 
velocity, or inertial sensor. 

“(s)” means one or more of the tiling meant by the word 
preceding “(s)”. Thus, characteristic(s) means one or more 
characteristics. 

65 The adaptive control system 10 of FIG. 1 operates in a 
control cycle that is repeatedly executed to control the plant 
12 on an ongoing basis, at least until control is terminated. 
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The basic function of the system 10 is to generate a 
commanded control signal d cjnd using a commanded state 
signal x„ a plant state signal x p an adaptive control signal 
v ad , and optionally a reference model state signal x,. m . In the 
case of the first execution of the control cycle, when 5 
previous values of the plant state signal x p and the adaptive 
control signal v ad are employed, they are assigned predeter- 
mined values, respectively. The commanded state signal x r 
is used by the controller 14 along with the plant state signal 
x p and an adaptive control signal v ad to generate at least one to 
control signal d. If adaptation to one or more characteristics 
of the controller 14 is to be avoided, the controller 14 is 
implemented to generate an input control signal d,„ that is 
the control signal d generated by the controller 14 before 
imposition of the characteristic(s) on such control signal, 15 
and a command control signal d crnd that is the input control 
signal d in , modified by the controller’s characteristic. The 
controller 14 is coupled to supply the command control 
signal d cmd to the actuator 16 that controls the state of the 
plant 12. The plant state is sensed by the sensor(s) 18 to 20 
generate a plant state signal x p . The hedge unit 20 is coupled 
to receive the input control signal d in and the command 
control signal d cmd for the control cycle under execution 
from the controller 14. In addition, the hedge unit 20 is 
coupled to receive the plant state signal x p , and optionally 25 
the actuator state signal x. The hedge unit 20 uses a plant 
model to predict the plant states resulting from the input 
command signal d in and the command control signal d cmd , 
and generates a hedge signal v h based on a difference 
between these two predicted plant states. Therefore, the 30 
hedge unit 20 generates the hedge signal v ; , to isolate the 
contribution to plant state that results from the presence of 
the control characteristic(s) in the command control signal 
d cmd . In addition, the hedge unit 20 can impose a plant model 
without one or more plant characteristic(s) for which adap- 35 
tation is not to be performed by the system 10, and a plant 
model that includes the plant characteristic(s). By using the 
plant model without the plant characteristic to modify the 
input control signal d 1>; to generate a first signal and by using 
the plant model with the characteristic(s) to modify the 40 
command control signal d OT , rf to generate a second signal, the 
hedge unit 20 can generate the hedge signal \ h to isolate the 
contribution to plant state that results from the presence of 
the plant characteristic. The hedge unit 20 is coupled to 
supply the hedge signal v ; , to the reference model unit 22. 45 
The reference model unit 22 is also coupled to receive the 
commanded state signal x,,. The reference model unit 22 uses 
the hedge signal v ; , and a reference model indicating the 
target state of the plant based on the commanded state, to 
modify the commanded state signal x,. to include the con- 50 
tribution to plant state caused by the characteristic(s) to be 
hedged. The comparator 24 is coupled to receive the refer- 
ence model state signal x rm and the plant state signal x p , and 
generates a tracking error signal e. The comparator 24 can 
generate the tracking error signal e by differencing the plant 55 
state signal x p and the reference model state signal x rm to 
generate the tracking error signal e. The comparator 24 is 
coupled to supply the tracking error signal e to the adapta- 
tion law unit 26. Because the characteristic(s) for which no 
adaptation of control response is to be made has been 60 
removed, at least partially, from the tracking error signal e, 
the adaptation law unit 26 will necessarily not adapt to such 
characteristic(s). Accordingly, the presence of the character- 
istic^) has no impact on performance of the adaptation law 
unit 26. The adaptation law unit 26 generates an adaptive 65 
control signal v ad based on the tracking error signal e. The 
adaptation law unit 26 can optionally be coupled to receive 
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the plant state signal x p as indicated by the broken line in 
FIG. 1, for use in generating the adaptive control signal v ad . 
In addition, the adaptation law unit 14 can be coupled to 
receive a pseudo-control signal v generated by the con- 
troller 14 for use by the adaptation law unit 26 in generating 
the adaptive control signal v ad . 

In FIG. 2, the controller 14 includes a control model 140 
and a control allocation and characteristic unit 142. The 
control model 140 and the control allocation and character- 
istic unit 142 can be implemented as software modules 
within the hedge unit 14. Hie control model 140 is basically 
a software implementation of the control law to be imple- 
mented by the adaptive control system 10 to control the plant 
12. The control model 140 is coupled to receive either the 
commanded state signal x,, or the reference model state 
signal x rm , and is also coupled receive the plant state signal 
x , and the adaptive control signal v ad . The control model 
140 maps these signals to the input control signal d,„. Those 
of ordinary skill in the art will understand how to generate 
a control law appropriate for a plant controlled by the 
adaptive control system 12. For example, the control model 
140 can be a linear proportional plus derivative, or propor- 
tional plus integral control law implemented in a software 
module or function. The control model 140 is coupled to 
supply the input control signal d„, to the control allocation 
and characteristic unit 142. The unit 142 maps the input 
control signal d„, to the control signal d cmd . The unit 142 can 
map the input control signal d tn , to the control signal d cmd so 
as to allocate control responsibility for the plant’s controlled 
degree of freedom based on a predetermined scheme. For 
example, the plant 12 could be an aircraft configured so the 
ailerons on both wings can be controlled to achieve a 
commanded roll attitude. The unit 142 can serve to allocate 
the amount of aileron deflection to the two actuators that 
control the wing ailerons so as to influence the roll attitude 
commanded by the input control signal d,„. The unit 142 can 
include the on-line identification of a model of the plant and 
the optimal or near-optimal allocation of multiply-redundant 
control effectors based on the solution of an optimization 
scheme that employs either the identified plant model or a 
stored model of the plant. The unit 142 can also impart 
control characteristic(s) to the input control signal d in to 
generate the control signal d cmd . Such control characteristic 
(s) could be control limits such as actuator end points that 
cannot be exceeded due to limitations of the actuator or 
associated control linkages. Alternatively, the control char- 
acteristic^) could be conservative authority limits placed on 
the control signal d,-,,, to insure the actuator end points are 
never encountered. For example, the actuator may be 
capable of moving a control surface by ±2 1 degrees of angle. 
If the input control signal d,„, designates 25 degrees of angle, 
the unit 142 will clip the input control limit d,,,, to produce 
a command control signal of 20 degrees of angle. Another 
control limit may pertain to an actuator’s rate limit. It is 
possible that the input command signal d„„ may command 
the actuator 16 to respond more rapidly than it is able. 
Accordingly, the unit 142 can be programmed to generate 
the command control signal d cmd to move the actuator 16 
more gradually as compared to the input control signal d !>; . 
As another example, the actuator 16 may be able to move 
only in quantized steps. The unit 142 can be used to map the 
control signal d ;> „ to the command control signal d cmd so that 
the command control signal is quantized. In addition, the 
unit 142 can be used to impose authority limits on the 
actuator 16. Thus, although an actuator 16 can be capable of 
actuation to the point of endangering the plant, the unit 142 
can be used to impose a control limit on the actuator 16. 
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Therefore, for example, if the operator 30 is an auto-pilot 
monitored by a human pilot to take control in emergency 
situations, the auto-pilot can be limited to control the aircraft 
plant 12 to limits set by the unit 142. Control limits set by 
the unit 142 can also be imposed by the sensor 18. For 5 
example, if the actuator 16 can change the state of the plant 
12 faster than the sensor 18 can sense the resulting changes, 
the unit 142 can limit the input control signal d !n to generate 
the command control signal d cmd to change the plant’s state 
in a manner the sensor 18 can accurately sense. Yet another to 
example of a control limit is the finite time required of a 
processor to process the various input signals to the con- 
troller and to generate the controller’s output signals. 

Turning now to FIG. 3, the hedge unit 20 includes a hedge 
model 200 having a plant model 201 without the plant 15 
characteristic that is to be hedged and a plant model 202 with 
the plant characteristic(s) that is/are to be hedged, and a 
comparator 204. These elements of the hedge unit 20 can be 
implemented as one or more software modules or functions 
within the hedge unit 20. The plant model 201 without the 20 
characteristic(s) is coupled to receive the input control signal 
d irl , and the plant state signal x p . The plant model 202 with 
the characteristic(s) generates a first signal that indicates the 
predicted plant response to the input control signal d,,, given 
the plant state signal x p . The plant model 202 with the plant 25 
characteristic(s) that is to be hedged is coupled to receive the 
command control signal d cmd and the plant state signal x p . 
Based on these signals, the plant model 202 with the 
characteristic(s) to be hedged is used to generate a second 
signal. The comparator 204 is coupled to receive the first 30 
signal from the plant model 201 not having the plant 
characteristic to be hedged, and the plant model 202 having 
the characteristic(s) to be hedged. The comparator 204 
diflerences the first and second signals to generate the hedge 
signal \ h . The hedge signal v h in effect isolates the plant 35 
and/or system characteristic(s) that are to be hedged. 

In FIG. 4, details of a possible implementation of the 
reference model unit 22 are shown. The reference model unit 
22 includes a reference model 220, a comparator 222, and a 
state computation unit 224. The reference model 220 40 
receives the commanded state signal x p , and the reference 
model state signal x rm from the state computation unit 224. 
The reference model 220 generates a signal x,.' based on the 
commanded state signal x,. and the reference model state 
signal x rm . The reference model 220 is a software module or 45 
function that maps the commanded state signal x„ to the 
reference model state signal x rm . The reference model state 
signal x rm represents the target plant state corresponding to 
the commanded state signal x r . The signal x,! from the 
reference model 220 is supplied to the comparator 222. The 50 
comparator 222 also receives the hedge signal v ; , from the 
hedge unit 20. Hie comparator 222 subtracts the hedge 
signal v ; , from the signal x,.' to generate the signal x,.". The 
signal x r " is supplied to the state computation unit 224. The 
state computation unit 224 computes the reference model 55 
state signal x rm from the signal x,.". More specifically, the 
state computation unit 224 computes scalar, derivative and / 
or integral values of the signal x," according to the fonn or 
order of the reference model. Accordingly, the state com- 
putation unit 224 generates the reference model state signal 60 
x,. m as a vector with scalar, integral and/or derivative terms 
using the commanded state signal x,. as modified in the unit 
22 by the hedge signal v h , and the reference model 222. The 
state computation unit 224 supplies the resulting reference 
model state signal x rm or predetermined terms thereof as a 65 
feedback signal to the reference model 220. The state 
computation unit 224 also supplies the reference model state 
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signal x,.„, to the comparator 24. The reference model state 
signal x rm includes the reference model response to the 
characteristic to be hedged so that it can be used in the 
comparator 24 to extract from the plant state signal x p the 
contribution to plant state resulting from the presence of the 
characteristic(s). Accordingly, the effect of the characteristic 
is eliminated or at least reduced from the tracking error 
signal e so that the adaptation law unit 26 will not adapt to 
the characteristic’s impact on the system 10 or the plant 12. 
Of course, it may not be possible to remove all impact of the 
characteristic from the tracking error signal e. However, 
enough of the impact of the characteristic should be 
removed from the tracking error signal e so that system 
control of the plant will not be compromised. Satisfaction of 
this objective depends upon pre-specifications for the system 
based on control performance objectives, control stability, 
and the nature of the control system 10 and plant 12. 

FIG. 5 is a possible implementation of the system 10. The 
actuator 16, the sensor 18, the operator interface unit 28, the 
command unit 32, a processor 34, and a memory 36 are 
coupled to a bus 38. The processor 34 can be a micropro- 
cessor or a microcontroller, for example. For example, the 
processor 34 could be a microprocessor with 64-bit word 
size operating at a 1 .0 GHz instruction execution cycle. The 
processor 34 can be a Pentium® III microprocessor com- 
mercially-available from Intel Corporation, Santa Clara, 
Calif., or an Athlon® microprocessor from Advanced Micro 
Devices®, Inc., Sunnyvale, Calif. The memory 36 stores a 
control program 360 and data 362. The control program 360 
is executed by the processor 34 in the performance of a 
control cycle of the adaptive control system 1 0. The control 
program 360 includes the software modules used to imple- 
ment the controller 14, the hedge unit 20, the reference 
model unit 22, the comparator 24, and the adaptation law 
unit 26. The data 362 includes data used by the processor 34 
in executing the software modules of the control program 
360 or temporary data generated by the processor 34 as it 
executes the control program 360. In the operation of the 
system 10 of FIG. 5, the sensor 18 has sensed the state of 
plant 12 to generate the plant state signal x p . The plant state 
signal x p has been stored as data 362 stored in the memory 
36 via the bus 38. Also, signals required for use in the next 
control cycle which could include the adaptive control signal 
v ad and the plant state signal x p and possibly other signals as 
well, are stored as data 362 in the memory 36. Alternatively, 
the adaptive control signal v ad can be generated in the 
control cycle under execution using a fixed-point solution. 
The command unit 32 writes the commanded state signal x r 
for the current control cycle as data 362 stored in the 
memory 36. In executing its control program 360 over the 
control cycle under execution, the processor 34 reads the 
commanded state signal x r from the memory 36. The pro- 
cessor 34 also reads the plant state signal x p and the adaptive 
control signal v ad and generates the input control signal d in 
and the command control signal d cmd . Alternatively, the 
plant state signal x p or a construction thereof from the sensor 
signal derived from a time after execution of the previous 
control cycle can be stored in memory for use in the next 
control cycle. The processor 34 supplies the command 
control signal d cmd to the actuator 16 that controls the state 
of the plant 12 based thereon. The processor 34 also executes 
the control program 360 to generate the hedge signal v ; , 
based on the input control signal d irl the command control 
signal d cmd , the plant state signal x p , and optionally also on 
the actuator state signal x a . Processor 34 further executes the 
control program 360 to generate the reference model state 
signal x rm . The processor 34 subtracts the reference model 
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state signal x rm , from the plant state signal x p to generate the 
tracking error signal e. The processor 34 uses the tracking 
error signal e and optionally also the plant state signal x p and 
a pseudo-command signal v pr , to generate the adaptive 
control signal v ad . Hie processor 34 can store any signals 
needed for the next control cycle in the memory 36. 

The method of FIG. 6 follows operation of the adaptive 
control system 10 of FIGS. 1-5 over a control cycle. In step 
SI of FIG. 6, the method begins. In step S2 of FIG. 6, the 
command unit 32 generates the commanded state signal x,. 
based on the operator’s action and/or operator-generated 
signal. In step S3 the controller generates the input control 
signal d in based on the commanded state signal x r , the plant 
state signal x p from sensor 18 and the adaptive control signal 
v ad generated by the adaptation law unit 26. Alternatively, 
the commanded state signal x r is first used by the reference 
model unit 22 to generate the reference model state signal 
x rm . The controller 14 generates the input control signal d,„ 
based on the reference model state signal x rm , and the plant 
state signal x p from the sensor 18, and the adaptive control 
signal v ad generated by the adaptation law unit 26. In step S4 
the controller 14 generates the control signal d cmd based on 
the commanded state signal x r , and the plant state signal x p 
and adaptive control signal v ad using the control allocation 
and characteristic unit 142 of the controller 14. In optional 
step S5 the controller 14 generates a pseudo-control signal 
v pc based on the commanded state signal x,., and the plant 
state signal x and the reference model state signal x rm . In 
step S6, the controller 14 supplies the control signal d cmd the 
actuator 16 to control the plant 12. In step S7 the sensor 18 
senses the plant state. In step S9 the controller 14 generates 
the plant state signal x p based on the sensed plant state. In 
step S10 the processor 34 receives the plant state signal x . 
In step Sll the hedge unit 20 generates the hedge signal w h 
based on the input control signal d tn , the command control 
signal d cmd , optionally on the actuator state signal x a , the 
plant model with the characteristic whose effect is to be 
removed from the tracking error signal e supplied to the 
adaptation law unit 26, and the plant model without the 
characteristic whose effect is to be removed from the track- 
ing error signal. In step S12 the reference model unit 22 
generates the reference model state signal x ml , based on the 
commanded state signal x„ the hedge signal v ; ,, and the 
reference model. In step S13 the comparator 24 generates 
the tracking error signal e based on the plant state signal x p 
and the reference model state signal x rm . In step S14 the 
adaptive law unit generates the adaptive control signal w ad 
based on the tracking error signal e and/or the pseudo- 
control signal v pc generated by the controller 14. In step S15, 
the processor 34 stores any signals required for the next 
control cycle in the memory 36. Such signals might include 
the plant state signal x p and the adaptive control signal v ad . 
In step S16 the method of FIG. 6 ends. 

FIGS. 7-13 are views of an exemplary embodiment of the 
adaptive control system 10. In FIG. 7 the controller 14 
comprises the control model 140 and the control allocation 
and characteristic unit 142. The control model 140 includes 
a linear control module 144, a summing unit 146, and an 
approximate dynamic inversion module 148. The linear 
control module 144 generates a linear control signal v fc , 
based on the tracking error signal e. More specifically, the 
linear control module 144 applies a linear control law to map 
the tracking error signal e to the linear control signal v lc . The 
reference model unit 22 generates the reference model signal 
v,. m that is a subset of the vector of the reference model state 
signal x rm . The linear control module 144 and the reference 
model unit 22 are designed to control the plant 12 for target 
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system response and stability using design techniques well- 
known to those of ordinary skill in the art. In the exemplary 
embodiment of FIG. 7, the adaptation control unit 26 
includes a neural network 260. The neural network 260 
5 receives as inputs the plant state signal x and a pseudo- 
control signal v pc , and the tracking error signal e. The neural 
network 260 maps the plant state signal x to the adaptive 
control signal v ad using connection weights adaptively set 
each control cycle by the tracking error signal e and the 
to pseudo control signal v . By updating the connection 
weights of the neural network 260 with successive control 
cycles, the system 10 is adaptive to changes over time in the 
plant 12 as well as the system 10. The pseudo-control signal 
v is used in part to adapt the connection weights of the 
15 neural network 260 generated in the control model 140. In 
the control model 140, the adaptive control signal v ad is 
subtracted from the sum of the reference model signal v rm 
and the linear control signal v ad in the summing unit 146 to 
generate pseudo-control signal v . The pseudo-control sig- 
20 nal w pc is supplied to the hedge unit 20 for optional use in 
generating the hedge signal v h . The pseudo-control signal 
v is also supplied to a dynamic inversion unit 148 of the 
control model 140. The dynamic inversion unit 148 inverts 
the pseudocontrol signal v based on an inversion function 
25 representing the plant control response. The inversion func- 
tion is a function of the plant state signal x p and the 
pseudo-control signal v . The inversion function maps 
these signals to the input connnand signal d tn . The remainder 
of the adaptive control system 10 is similar in function and 
30 configuration to previously described embodiments. 

FIG. 8 is an exemplary embodiment of the hedge unit 20 
of FIG. 7. In this embodiment, the first signal d : supplied to 
the comparator 204 can be generated in one of two ways. 
More specifically, the plant state signal x p and the input 
35 connnand signal d iw can be supplied to the plant model 210 
that includes an inversion function to generate the first signal 
dj based on these signals. Alternatively, the pseudo-control 
signal \ pc can be supplied as the first signal d : directly to the 
comparator 204. The command control signal d cmd is sup- 
40 plied to the plant model 202 that includes an actuator model 
206 for one or more characteristics of the actuator 16 to be 
hedged, and a plant model 208 with one or more character- 
istics of the plant 12 to be hedged. The command control 
signal d cmd is fed to the actuator model 206 to generate 
45 command signal 6. The command signal 5 is supplied to the 
plant model 208 along with the plant state signal x p for use 
in generating the second signal d 2 supplied to the comparator 
204. The comparator 204 generates the hedge signal v ; , by 
subtracting the first and second signals d 1; d, to isolate the 
50 effect of the characteristics to be hedged. 

In FIG. 9 a relatively detailed example of the reference 
model unit 22 is shown. The reference model unit 22 in this 
case is second-order, and has constant, derivative, and 
double derivative terms. The reference model unit 22 
55 includes a comparator 222, a multiplier 226, a summing unit 
228, integrators 230, 232, and multipliers 234, 236. The 
multiplier 226 multiplies the commanded state signal x,. by 
a predetermined constant w„ 2 to generate a modified signal 
supplied to the summing unit 228. The su mmin g unit 228 
60 subtracts signals from the multipliers 234, 236 from the 
modified signal from the multiplier 228 to generate the 
reference model signal v rm . The summing unit 228 supplies 
the reference model signal v rm to the controller 14. The 
su mmi ng unit 228 also supplies the reference model signal 
65 \ rm to the comparator 222. The comparator 222 subtracts the 
hedge signal v h from the reference model signal v rm to 
generate a signal supplied to the integrator 230. The inte- 
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grator 230 integrates the signal from comparator 222 to 
generate integrated signal x rm . The integrated signal x rrn is 
supplied to the integrator 232 to generate the reference 
model state signal x„„ that in this case has a “constant” term, 
a derivative term, and a second-derivative term. The refer- 5 
ence model state signal x rm is supplied to the comparator 24. 
The integrated signal x rm from the unit 230 is also supplied 
to the multiplier 234 that multiplies this integrated signal by 
the constant 2^o>„ in which £ and are constants, and 
supplies the resulting signal to the summing unit 228. The to 
“constant” term from the reference model state signal x rm is 
also supplied to the multiplier 236 that multiplies this signal 
by the constant o)„ 2 to generate a signal supplied to the 
summing unit 228. The signals from multipliers 234, 236 are 
subtracted from the signal from multiplier 226 to generate 15 
the reference model signal v rm . 

FIG. 10 is a diagram of a neural network 260. The neural 
network 260 includes an input layer 262, a hidden layer 264, 
and an output layer 266. The input layer 262 has Nj nodes 
receiving elements of the plant state signal x and the 20 
pseudo-control signal v pc , N : being a positive integer. The 
N : th nodes of the input layer 262 are multiplied by respec- 
tive connection weights V to generate the input signals to the 
N 2 nodes of the hidden layer 264, N 2 being a positive integer. 
The weighted input signals to the hidden layer 264 are 25 
supplied as input signals to the sigmoidal activation function 
a ( z ) of the form: 


“-1” or mapped by the neural network 260 to generate the 
signal-v orf for supply to the controller 14. 

The manner in which the tracking error signal e and the 
input layer signal are used to adapt the connection weights 
V and W is now described. The pseudo-control signal v is 
generated using the reference model signal v,. m , the linear 
control signal v fc and the adaptive control signal \ ad , as 
follows: 


The pseudo-control signal v is related to the acceleration 
term of the reference model state. The pseudo-control signal 
can be further augmented by terms as may be required to 
support proof of boundedness. An example of a term is 
commonly referred to as the robustifying tenn and is well 
know to those of ordinary skill in the art. Dynamic inversion 
is used to reduce the control design problem to that of a 
control design for a linear, time-invariant plant. However, as 
is well-known to those of ordinary skill in this technology, 
use of an imperfect model in the dynamic inversion process 
can corrupt the desired relationship between acceleration of 
the plant state vector and the pseudo-control by an amount 
A often referred to as an inversion error. This relationship 
between acceleration of the plant state, pseudo-control, and 
the inversion error is defined in Equation (5). 


The derivative of the tracking error signal e can be 
expressed as: 

e=Ae+b( k+v ad ) (6) 


in which a is a predetermined constant and z represents the 
V-weighted input signals from the input layer 262. The 
outputs from the hidden layer 264 are weighted by the 
connection weights W, and are supplied as input signals to 
respective nodes 1-N 3 of the output layer 266. These nodes 
add respective input signals to generate the adaptive control 
signal -v ad . The mapping of the plant state signal x p to the 
adaptive control signal v ad performed by the neural network 
260 can be expressed as: 


: Yj 

\k=i 


Vj k x k + b Vj + b Wi 


in which A is Hurwitz. The output of the neural network v ad 
used to approximate the inversion error, A so that the error 
dynamics of Equation (6) will remain bounded, and tracking 
error is minimized. The constant £, is defined by the equa- 
tion: 


in which e T is the transpose of the tracking error signal e, b 
is a predetermined matrix constant from Equation (6), and P 
is the solution of a Lyapunov equation (8). 

a t p+pa=-q (8) 


1= 1 , 2 Ni 


(2) 4 ’’ in which Q is a positive definite matrix. The adaptation law 
for updating the neural network weights and implemented 
by the adaptation law unit 26 can be expressed as: 

T=-[S5fF r a'+x,pigr|rv (9) 


where N 1; N 2 , N 3 are the number of nodes in the input, 
hidden, and output layers 262, 264, 266, respectively, ref- 
erenced by corresponding indexes k, j, i. The connection 
weights \ Jk and w tf are set adaptively by the states of the 
tracking error signal e and the N\ inputs to the neural 
network input layer 262. The constants b vj and b^,- are 
predetermined. In matrix form equation (2) can be expressed 
as: 

60 

v a ^y=W r o{V r 2) (3) 

in which x is the neural network input signal, V T is the 
transpose of the connection weight vector V, cr is the 
sigmoidal activation function, W r is the transpose of the 65 
connection weight vector W, and y=v ad is the adaptive 
control signal. The signal v ad can either be multiplied by 


w=-r fr [(o-&r I x)i;+x., f Ji;iw/ (to) 

in which V is the derivative of the connection weight vector 

V of the neural network 260, W is the derivative of the W 

weight vector of the neural network 260, a' (z) is the partial 
derivative of sigmoidal function a (z) with respect to z, X K , 
^■wt U, r w are predetermined vectors, and x is the plant 
state signal. 

For the case of a second-order reference model (FIGS. 
7-10 ) the remaining characteristics are: 

Xp=Ax P ,Xp,dc m J,d i „)) ( 11 ) 

( 12 ) 

Vi=K p (x rm -x p )+K D (x rm -x p ) (13) 
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'’ h =v pc -Jlx p ,x p ,d cm /d in )) ( 15 ) 

di„=r l (x p ,x p ,v pc ) ( 16 ) 


in which and are predetennined constants. Equation 5 
( 16 ) corresponds to the dynamic inversion unit 148 of FIG. 

7 . The tracking error signal e can be expressed as the vector 
of differences: 


e - 
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( 17 ) 


It can be shown that whether h=d t „=d cmd or b=d J>! , *d cmd , 15 
the following equation holds: 

e=Ae+b[&(x p ,x p ,i cmJ )+v ad \ ( 18 ) 

Hence, due to the hedge signal v h generated by the hedge 
unit 20, the adaptive control system 10 is bounded with ., (| 
respect to tracking error and neural network weights. The 
plant will track the desired response as close as is possible 
within the limits of d cmd . Without the hedge unit 20 , it can 
be shown that the system 10 would not be stable for cases 
in which & in *& cmd - 25 

In FIG. 11 a special case of the control allocation and 
characteristic unit 142 is shown. More specifically, the unit 
142 includes an operator interface unit 144 , and operator 
146 , and a command unit 148 . The operator interface unit 
144 receives the input command signal d in and the plant state 30 
signal x p and generates a signal or display based on these 
signals. The operator 146 can be a human operator, a 
computer, or other machine, for example. In the case of a 
human operator, the operator interface unit generates a 
display based on the input command signal d,„ and the plant 35 
state signal x p . The operator 146 uses the display from the 
operator interface unit 144 to control the command unit 148 
to generate the command control signal d cmd . The command 
control signal d cmd is supplied to the actuator 16 to control 
the state of the plant. The configuration of the unit 142 in 40 
FIG. 11 is useful in numerous contexts. For example, in an 
aircraft, it may be desirable to have an auto-pilot whose 
control of the aircraft is limited. In situations in which it is 
not desirable for the auto-pilot to control the aircraft, such as 
take-off or landing in which emergency maneuvers are more 45 
likely to be required, the aircraft’s flight control system can 
be implemented to switch the operator 146 into the control 
loop with units 144 and 148 as shown in FIG. 11 . In this 
configuration, control and response characteristic(s) gener- 
ated by the operator are hedged by the hedge unit 20 . One 50 
barrier to implementation of adaptive control systems in 
contexts such as aircraft is the stringent testing and certifi- 
cation required of adaptive control systems. Certification is 
made difficult by the fact that it may be exceedingly difficult 
or impossible to subject the adaptive control system to all 55 
plant states it is likely to encounter. The configuration of 
FIG. 11 provides the advantage of permitting the use of an 
adaptive control system in which the pilot operator can 
control the aircraft without causing the control system to 
adapt to the pilot’s control and response. Accordingly, the 60 
configuration of FIG. 11 should facilitate testing and certi- 
fication of an adaptive control system incorporating the 
features of the unit 142 in FIG. 11 . 

Hie adaptive control system 10 can be used in numerous 
applications. For example, the plant 12 can be a manned or 65 
unmanned vehicle. Such vehicle can be an aircraft, space- 
craft, missile, or guided ordinance. In general, the adaptive 
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control system 10 is assigned to control one degree of 
freedom of the plant 12 . The actuator 16 , the sensor 18 , the 
operator interface unit 28 , the operator 30 , and the command 
unit 32 depend upon the nature of the plant 12 and the degree 
of freedom thereof to be controlled by the adaptive control 
system 10 . For example, if the plant 12 is a guided vehicle 
such as an aircraft, spacecraft, missile or other guided 
ordinance, the actuator 16 could be a motor, a motor-driven 
screw, a hydraulic cylinder or other device attached to a 
control surface such as an aileron, rudder, or stabilizer. 
Alternatively, the actuator 16 could be a pump or valve that 
generates air jet(s) to change the flow of air over the guided 
vehicle’s surface, or a frame actuator that changes the shape 
of the guided vehicle’s surface. In addition, the actuator 16 
could be thrust controllers to control the direction of thrust 
generated by a power plant of the aircraft. Such actuators 
can be used to control the degree of freedom (e.g., pitch, roll, 
or yaw) that is controlled by the adaptive control system 10. 
In the guided vehicle context, the sensor 18 can be a 
gyroscope or other device to measure the degree of freedom 
controlled by the actuator 16 . In the case of a manned 
vehicle, the operator 30 can be a human, the operator 
interface unit 28 a display, and the command unit 32 a 
control stick and/or flight control system, for example. If the 
plant 12 is an automobile, the actuator 16 can be a valve for 
a fuel injection port, a hydraulic cylinder to move a braking 
element into contact with a brake drum, a transmission or 
other element. In this case, the sensor 18 can be a speed- 
ometer, a pressure sensor in an engine cylinder, an inertial 
sensor, or other elements. The plant 12 could also be a 
satellite, and the actuator 1 6 could be a thruster to orient and 
position the satellite in orbit. The satellite’s actuator 16 
could be a motor-driven electro-mechanical device to posi- 
tion a solar panel or transceiver unit in a desired direction. 
In the satellite context, the sensor 18 could be a gyroscope, 
for example. As another example, the operator 30 can be a 
combination of an auto-pilot and a human operator to take 
control of the plant in circumstances in which the auto-pilot 
is not to control the plant. Such implementation can be used 
in aircraft, for example. The command unit 32 can be 
programmed to switch control between a machine and 
human operator to control the aircraft plant 12 . The hedge 
unit 20 can generate the hedge signal to hedge characteris- 
tics of the human control of the command unit 32 for stable 
control of the aircraft plant. It should be understood that the 
use of a vehicle context in the foregoing description is 
exemplary only, and is not intended to limit the scope or 
context in which the invented adaptive control system 10 
can be used. Those of ordinary skill in the art should 
understand that the system 10 can be used in numerous other 
contexts and environments, such as manufacturing plants, 
power generation stations, and numerous other types of 
plants. 

Any trademarks listed herein are the property of their 
respective owners, and reference herein to such trademarks 
is intended only to indicate the source of a particular product 
or service. 

The many features and advantages of the present inven- 
tion are apparent from the detailed specification and it is 
intended by the appended claims to cover all such features 
and advantages of the described methods and apparatus 
which follow in the true scope and spirit of the invention. 
Further, since numerous modifications and changes will 
readily occur to those of ordinary skill in the art, it is not 
desired to limit the invention to the exact implementation 
and operation illustrated and described. Accordingly, all 
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suitable modifications and equivalents may be resorted to as 
falling within the scope and spirit of the invention. 

The invention claimed is: 

1. A method comprising the step of: 

a) generating a hedge signal with an adaptive control 5 
system to avoid adaptation to at least one characteristic 
of the adaptive control system, the characteristic having 
an effect to which adaptation would be detrimental to 
control of a plant with the adaptive control system. 

2. A method as claimed in claim 1 further comprising the to 
steps of: 

b) modifying a commanded state signal with the hedge 
signal; and 

c) generating a reference model state signal based on the 
commanded state signal modified with the hedge signal 15 
in the step (b). 

3. A method as claimed in claim 2 further comprising the 
step of: 

d) generating a tracking error signal based on the refer- 
ence model state signal and a plant state signal; and 20 

e) generating an adaptive control signal based on the 
tracking error signal to adapt control response of the 
adaptive control system. 

4. A method as claimed in claim 1 wherein the plant is an 

aircraft and/or spacecraft. 25 

5. A method as claimed in claim 1 wherein the plant is an 
automobile. 

6. A method as claimed in claim 1 wherein the plant is an 
unmanned vehicle. 

7. A method as claimed in claim 1 wherein the charac- 30 
teristic pertains to a control limit of the actuator used to 
control the plant. 

8. A method as claimed in claim 7 wherein the control 
limit pertains to actuator end points. 

9. A method as claimed in claim 7 wherein the control 35 
limit pertains to actuator dynamics. 

10. A method as claimed in claim 7 wherein the control 
limit pertains to a rate limit of the actuator. 

11. A method as claimed in claim 7 wherein the control 
limit pertains to quantization effects associated with the 40 
actuator. 

12. A method as claimed in claim 1 wherein the charac- 
teristic relates to a control limit of the sensor. 

13. A method as claimed in claim 1 wherein the control 
limit relates to a speed at which the sensor can sense a state 45 
of the plant. 
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14. In an adaptive control system for controlling a plant, 
a hedge unit coupled to receive at least one control signal 
and a plant state signal, the hedge unit generating a hedge 
signal based on the control signal, the plant state signal, and 
a hedge model including a first model having a characteristic 
of the adaptive control system to which the adaptive control 
system is not to adapt, and a second model not having the 
characteristic to which the adaptive control system is not to 
adapt, the hedge signal used in the adaptive control system 
to remove an effect of the characteristic from a signal 
supplied to an adaptation law unit of the adaptive control 
system so that the adaptive control system does not adapt to 
the characteristic in controlling the plant, the characteristic 
having an effect to which adaptation would be detrimental to 
control of a plant with the adaptive control system. 

15. An adaptive control system as claimed in claim 14 
wherein the characteristic pertains to a control limit of the 
actuator used to control the plant. 

16. An adaptive control system as claimed in claim 14 
wherein the control limit pertains to actuator end points. 

17. An adaptive control system as claimed in claim 14 
wherein the control limit pertains to actuator dynamics. 

18. An adaptive control system as claimed in claim 14 
wherein the control limit pertains to a rate limit of the 
actuator. 

19. .An adaptive control system as claimed in claim 14 
wherein the control limit pertains to quantization effects 
associated with the actuator. 

20. An adaptive control system as claimed in claim 14 
wherein the plant is an aircraft and/or spacecraft. 

21. .An adaptive control system as claimed in claim 14 
wherein the plant is an automobile. 

22. An adaptive control system as claimed in claim 14 
wherein the plant is an unmanned vehicle positioned 
remotely from an operator. 

23. A system as claimed in claim 14 wherein the charac- 
teristic relates to a control limit of the sensor. 

24. A system as claimed in claim 23 wherein the control 
limit relates to a speed at which the sensor can sense a state 
of the plant. 





